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ABSTRACT 

Objective: To examine the validity of the International 
Classification of Diseases, 10th revision (ICD-10) 
codes for hyponatraemia in the nationwide population- 
based Danish National Registry of Patients (DNRP) 
among inpatients of all ages. 
Design: Population-based validation study. 
Setting: All somatic hospitals in the North and Central 
Denmark Regions from 2006 through 2011. 
Participants:: Patients of all ages admitted to hospital 
(n=819 701 individual patients) during the study 
period. The patient could be included in the study 
more than once, and our study did not restrict to 
patients with serum sodium measurements (total of 
n=2 186 642 hospitalisations). 
IVIain outcome measure: We validated ICD-10 
discharge diagnoses of hyponatraemia recorded in the 
DNRP, using serum sodium measurements obtained 
from the laboratory information systems (LABKA) 
research database as the gold standard. One sodium 
value <135 mmol/L measured at any time during 
hospitalisation confirmed the diagnosis. We estimated 
sensitivity, specificity, positive predictive value (PPV) and 
negative predictive value (NPV) for ICD-10 codes for 
hyponatraemia overall and for cut-off points for 
increasing hyponatraemia severity. 
Result: An ICD-10 code for hyponatraemia was recorded 
in the DNRP in 5850 of the 2 1 86 642 hospitalisations 
identified. According to laboratory measurements, 
however, hyponatraemia was present in 306 418 (14%) 
hospitalisations. Sensitivity of hyponatraemia diagnoses 
was 1 .8% (95% C1 1 .7% to 1 .8%). For sodium values 
<1 15 mmol/L, sensitivity was 34.3% (95% CI 32.6% to 
35.9%). The overall PPV was 92.5% (95% CI 91 .8% to 
93.1%) and decreased with increasing hyponatraemia 
severity. Specificity and NPV were high for all cut-off 
points (>99.8% and >86.2%, respectively). Patients with 
hyponatraemia without a corresponding ICD-10 
discharge diagnosis were younger and had higher 
Charlson Comorbidity Index scores than patients with 
hyponatraemia with a hyponatraemia code in the DNRP. 
Conclusions: ICD-10 codes for hyponatraemia in the 
DNRP have high specificity but very low sensitivity. 



Strengths and limitation of this study 



■ This is the first study to validate the International 
Classification of Diseases, 10th revision code for 
hyponatraemia in hospitalised patients of all 
ages. 

■ We used a population-based design, utilizing 
unambiguous individual-level linkage between 
registries containing complete data on all hospi- 
talisations and laboratory measurements, thereby 
ensuring a large sample size and virtually elimin- 
ating the risk of selection bias. 

■ We did not consider the duration of hyponatrae- 
mia. Sensitivity may have been higher if the 
presence of hyponatraemia required that it was 

I detected in more than one laboratory measure- 
ment during hospitalisation. 



Laboratory test results, not discharge diagnoses, should 
be used to ascertain hyponatraemia. 



INTRODUCTION 

Hyponatraemia, defined as a serum sodium 
value <135 mmol/L, is the most common elec- 
trolyte abnormality encountered in clinical 
practice/ It can be caused by a large variety of 
conditions, such as heart failure, kidney 
failure, cirrhosis, syndrome of an inappropri- 
ate antidiuretic hormone, vomiting and diar- 
rhoea, and can also be a side effect of several 
medications.^ Results of recent studies have 
indicated that even a mild- to-moderate level of 
hyponatraemia may be an important predictor 
of poor prognosis in patients with cardiovascu- 
lar disease, kidney and liver disease and 
cancer^"^ However, key aspects of the aetiology 
and prognosis of hyponatraemia remain 
unknown. 
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The Danish population-based medical registries may 
offer a unique opportunity for studies of the epidemi- 
ology of hyponatraemia, if data are valid. However, as 
symptoms of mild and moderate hyponatraemia may be 
vague, and concealed by or construed as symptoms of 
an underlying disease, it is likely that the condition will 
not be reported.^ Thus, use of only inpatient dis- 
charge diagnoses of hyponatraemia in epidemiological 
studies may cause bias that can affect the validity of 
study results/^ 

Until now, only one study has investigated the validity 
of the International Classification of Diseases, 10th revision 
(ICD-10) codes for hyponatraemia. This Canadian study 
was restricted to patients 66 years of age or older with 
serum sodium values at the time of emergency depart- 
ment contact or at hospital admission. The sensitivity 
of hyponatraemia coding was found to be as low as 7%. 
For inpatients younger than 66 years, knowledge of the 
validity of hyponatraemia diagnoses is limited to a study 
performed in a single hospital in the Netherlands using 
ICD-9 codes for hyponatraemia. In this study, sensitivity 
was found to be just below 2%, using hospital laboratory 
data as the reference standard. Similar results were 
found in a study examining the validity of outpatient 
professional ICD-9 claims for hyponatraemia in the 

We therefore conducted the first population-based 
study examining the validity of ICD-10 inpatient dis- 
charge diagnoses of hyponatraemia in the Danish 
National Registry of Patients (DNRP) , including patients 
of all ages. 

METHODS 

Setting and data collection 

We used the DNRP to identify all admissions to hospitals 
in the North and Central Denmark Regions (2.1 million 
inhabitants in the study period) from 1 January 2006 to 
31 December 2011. The DNRP contains information, 
including date of admission and discharge, department 
code and discharge diagnoses, on all admissions to 
Danish non-psychiatric hospitals since 1977.^^ 

By use of the unique 10-digit civil registration number, 
assigned to all Danish residents since 1968,^^ we linked 
each patient's DNRP data to the clinical laboratory infor- 
mation system (LABKA) research database. For patients 
living in the North and Central Denmark Regions, data 
on virtually all specimens analysed in clinical laborator- 
ies by hospitals and medical practitioners are entered 
into a computer-based clinical laboratory information 
system, which functions as a routine diagnostic tool for 
medical personnel. Data are transferred electronically 
to the LABKA research database, managed by Aarhus 
University. Analyses are coded according to the NPU 
(Nomenclature, Properties and Units) system. The 
LABKA research database contains the civil registration 
number, time and date of blood sampling, and identifi- 
cation code of the requesting physician or hospital 



department. We used the LABKA research database to 
retrieve information on all serum sodium measurements 
recorded during each of the identified hospitalisations. 

Hyponatraemia diagnosis (ICD-10 code algorithm) 

At hospital discharge, the attending physician assigns 
one primary diagnosis, reflecting the main reason for 
hospitalisation and treatment and up to 19 secondary 
diagnoses regarding additional clinically relevant condi- 
tions, including underlying diseases, complications and 
symptoms. Diagnoses recorded in the DNRP have 
been coded according to the ICD-10 since 1994.^^ 

We developed an algorithm based on ICD-10 codes to 
identify primary and secondary discharge diagnoses of 
hyponatraemia recorded in the DNRP for each hospital- 
isation. The following ICD-10 codes were included in 
the algorithm: E87.1 (hypo-osmolality and hyponatrae- 
mia), E87.1A (hyponatraemia) and P74.2B (hyponatrae- 
mia in newborns (Danish version of ICD-10)). 

Gold standard (laboratory serum sodium measurements) 

We used serum sodium measurements recorded in the 
LABKA research database as the gold standard to confirm or 
disconfirm a diagnosis of hyponatraemia identified by the 
ICD-10 algorithm. Hyponatraemia was defined as serum 
sodium values <135 mmol/L for patients older than 30 days 
and <133 mmol/L for infants 30 days of age or younger 
Patients were considered to have hyponatraemia if at least 
one hyponatraemic serum sodium value was recorded 
during their hospitalisation. If no serum sodium measure- 
ment was available, the patient was assumed to have a non- 
hyponatraemic serum sodium value (135-145 mmol/L). 
The following cut-off points for increasing severity of hypona- 
traemia were chosen: 135, 130, 125, 120 and 115 mmol/L.^^ 
The corresponding levels for infants less than 31 days of age 
were 133, 128, 123, 118 and 113 mmol/L. 

Other variables 

For each patient, we assessed comorbidity by informa- 
tion retrieved from the DNRP on the conditions 
included in the Charlson Comorbidity Index (CCI). The 
CCI includes 19 medical conditions, each assigned a 
weighted score between 1 and 6. The sum of these indi- 
vidual scores is used as a measure of a patient's 
comorbidity burden. We calculated CCI scores for 
each patient and defined three comorbidity levels: low 
(CCI score 0), medium (CCI score 1-2) and high (CCI 
score of 3 or above). We included morbidities recorded 
within 10 years prior to the current hospitalisation, as 
conditions requiring hospital treatment within this time- 
frame would most likely influence the attending physi- 
cian's diagnostic approach and evaluation during the 
current hospitalisation. 

Furthermore, we obtained information on the depart- 
ment of admission and year of admission from the 
DNRP. Departments were categorised in the following 
five groups: internal medicine, surgery, gynaecology/ 
obstetrics, paediatrics and other. 
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Statistical analysis 

Patients with a hyponatraemic serum sodium value 
recorded in the LABKA research database were divided 
into two categories: Those with an ICD-10 code for 
hyponatraemia in the DNRP and those without. We 
described both groups of patients in terms of gender, 
age (median and associated IQR), department of admis- 
sion, CCI score and specific comorbidities. 

We estimated the sensitivity, specificity, positive predict- 
ive value (PPV) and negative predictive value (NPV; 
figure 1) for ICD-10 codes for hyponatraemia in the 
DNRP with corresponding 95% CI, using the exact 
method for binomial proportions. We defined sensitivity 
as the probability of an ICD-10 code for hyponatraemia 
being registered in the DNRP, when the laboratory test 
result identified the presence of hyponatraemia. 
Specificity was defined as the probability of an ICD-10 
code for hyponatraemia not being registered in the 
DNRP, when hyponatraemia was not identified in labora- 
tory test results. We estimated the PPV as the proportion 
of patients for whom an ICD-10 code for hyponatraemia 
recorded in the DNRP could be confirmed by a serum 
sodium measurement, and NPV as the proportion of 
patients with no ICD-10 code for hyponatraemia in the 
DNRP, for whom non-hyponatraemic or no serum 
sodium values were recorded in the LABKA research 
database. The analyses were repeated for all hyponatrae- 
mia cut-off points and after stratification by age group 
categories, department of admission and admission year. 

Finally, we conducted four sensitivity analyses. First, we 
performed a complete case analysis, a method for 
dealing with missing data considering only participants 
with recorded values for all covariates,^^ meaning that 
only patients with at least one serum sodium measure- 
ment during their hospitalisation were included in the 
analysis. We did so, in order to evaluate the assumption 
that patients without a serum sodium measurement were 



normonatraemic. In the second sensitivity analysis, we 
included only patients with more than one serum 
sodium measurement during their hospitalisation. In 
the third sensitivity analysis, we included only the 
ICD-10 codes E87.1A (hyponatraemia) and P74.2B 
(hyponatraemia in newborns). Because epidemiological 
studies often focus on incident cases, we performed a 
post hoc sensitivity analysis in which we restricted to the 
first hospitalisation for each patient in the study period. 

Data analyses were performed using the statistical soft- 
ware package STATA (V.12; Stata Corp, College Station, 
Texas, USA). 

All data were obtained from Danish public registries. 
According to Danish law their use does require 
informed consent or ethics committee approval. 

RESULTS 
Characteristics 

We identified 2 186 642 hospitalisations (819 701 
individual patients) within the study period. For 1 308 740 
(60%) hospitalisations, at least one serum sodium meas- 
urement was recorded in the LABKA research database, 
and for 1 037 647 (47%) hospitalisations subsequent mea- 
surements were recorded. According to the recorded 
serum sodium value, hyponatraemia was present in 
306 418 hospitalisations (14%). In the DNRP, we identified 
5850 hospitalisations with an ICD-10 code of hyponatrae- 
mia (hypo-osmolality and hyponatraemia=3722, hypona- 
traemia=2124, hyponatraemia in newborns=4) among all 
2 186 642 hospitalisations. Of these, 440 did not have a 
hyponatraemic serum sodium value recorded in the 
LABKA research database. 

Table 1 shows the distribution of hospitalisations by 
the presence/absence of an ICD-10 diagnosis of hypona- 
traemia recorded in the DNRP, by gender, age and 
comorbidity variables, for patients with hyponatraemic 



Figure 1 Schematic 2x2 table 
and validity measure estimation 
formulas. 



Hyponatraemic serum 
sodium value recorded in 
LABKA research database 
(gold standard) 



Yes 



No 



ICD-10 code of hyponatraemia 
recorded in the DNRP* 



Yes 



No 



C 
D 



Validity measures: 

Sensitivity= A/(A+C) 

Specifjcity= D/(B+D) 

Positive predictive value= A/(A+B) 

Negative predictive value=D/(C+D) 



*DNRP = Danish National Registry of Patients 
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serum sodium values. Patients who had an ICD-10 code 
of hyponatraemia recorded in the DNRP and a corre- 
sponding hyponatraemic serum sodium measurement 
were on average older, more often female, more likely 
admitted to an internal medicine department and char- 
acterised by lower comorbidity levels than patients with 
no hyponatraemia diagnosis in the DNRP, but having 
hyponatraemic serum sodium values recorded in the 
LABKA research database. Cerebrovascular disease, 
dementia and ulcer disease were the only comorbidities 
that were more frequently found in patients with an 
ICD-10 code for hyponatraemia and corresponding 
hyponatraemic serum sodium value, compared to 
patients with hyponatraemia without a hyponatraemia 
diagnosis in the DNRP (table 1). 



Sensitivity, specificity, PPV and NPV 

For 440 (7.5%) of the 5850 hospitalisations with an ICD-10 
code for hyponatraemia recorded in the DNRP, no hypo- 
natraemic serum sodium measurement was recorded in 
the LABKA research database during the hospitalisation 
(for 178, no measurement was recorded at all). This corre- 
sponds to a PPV of an ICD-10 code for hyponatraemia of 
92.5% (95% CI 91.8% to 93.1%) for serum sodium values 
<135 mmol/L (<133 mmol/L for infants 30 days of age or 
younger). As expected, PPV decreased with lower serum 
sodium cut-off points. A total of 5410 hospitalisations had 
both an ICD-10 code recorded in the DNRP and a corre- 
sponding hyponatraemic laboratory measurement, result- 
ing in a sensitivity of the ICD-10 codes of 1.8% (95% CI 
1.7% to 1.8%). Sensitivity increased with lower cut-off 



Table 1 Characteristics of hospitalisations identified in the DNRP from 2006 to 201 1 



I 



Hospitalisations with at least on serum sodium value 
<135 mmol/L recorded in the LABKA research 
database 



ICD-10 code of 
hyponatraemia in the 
DNRP (n=5410), n(%) 



No ICD-10 code of 
hyponatraemia in the 
DNRP* (n=301 008), n (%) 



All hospitalisations 
(n=2 186 642), n(%) 



Sex 

Female 3643 

Male 1767 

Age, years 

Median (IQR) 77.3 

Department of admission 

Internal medicine 5173 

Surgical 184 

Gynaecological/obstetric 1 0 

Paediatric 29 

Other 14 

CCI level (score) 

Low (0) 2075 

Medium (1-2) 2182 

High(>3) 1153 

Specific comorbidities 

Myocardial infarction 312 

Congestive heart failure 460 

Peripheral vascular disease 464 

Cerebrovascular disease 1 01 7 

Dementia 107 

Chronic pulmonary disease 870 

Connective tissue disease 291 

Ulcer disease 450 

Mild liver disease 189 

Moderate-to-severe liver disease 66 

Diabetes I and II 521 

Diabetes with complications 269 

Hemiplegia 35 
Moderate-to-severe renal disease 143 

Malignant tumour 781 

Leukaemia 22 

Lymphoma 51 

Metastatic cancer 1 83 

AIDS 3 



67.3) 
32.7) 

65.7-84.9) 

95.6) 

3.4) 

0.2) 

0.5) 

0.3) 

38.4) 
40.3) 
21.3) 

5.8) 
8.5) 
8.6) 
18.8) 
3.1) 
16.1) 
5.4) 
8.3) 
3.5) 
2) 
9.6) 
5.0) 
0.7) 
2.6) 
14.4) 
0.4) 
0.9) 
3.4) 
0.1) 



148 120 (49.3) 
152 588 (50.7) 

67.4 (54.2-78.2) 

184 848 (61.6) 
88 378 (29.4) 

7104 (2.4) 
15 830 (5.3) 

4848 (1 .6) 

100 398 (33.4) 
106 874 (35.5) 
93 736 (31.1) 

23 269 (7.7) 
31 236 (10.4) 
29 356 (9.8) 
39 466 (13.1) 

4247 (1 .4) 
48 726 (16.2) 
13 990 (4.7) 
20 645 (6.9) 
13 413 (4.5) 

6279 (2.1) 
39 995 (13.3) 
25 083 (8.3) 

2462 (0.8) 
20 123 (6.7) 
64 882 (21 .6) 

4636 (1.5) 

7096 (2.4) 
23 948 (8.0) 
475 (0.2) 



1 168 803 
1 017 839 

54.7 

943 121 
630 525 
347 365 
165 289 
100 342 

1 232 762 
588 783 
365 097 

108 373 
121 429 
115 620 
182 304 
20 711 
231 121 
73 299 
79 050 
37 698 
14 999 
150 205 
85 035 

16 060 
75 441 

312 845 

17 190 
25 348 

105 512 
2014 



53.5) 
46.5) 

29.3-71.1) 

43.1) 
28.8) 
15.9) 
7.6) 
4.6) 

56.4) 
26.9) 
16.7) 

5.0) 
5.6) 
5.3) 
8.3) 
1.0) 
10.6) 
3.4) 
3.6) 
1.7) 
0.7) 
6.9) 
3.9) 
0.7) 
3.5) 
14.3) 
0.8) 
1.2) 
4.8) 
0.1) 



CCI, Charlson Comorbidity Index; DNRP, Danish National Registry of Patients; ICD-10, International Classification of Diseases, 10th revision. 
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points for serum sodium, reaching 34.3% (95% CI 32.6% 
to 35.9%) for serum sodium <115mmol/L. Specificity 
and NPV for serum sodium <135 mmol/L were 100% 
(97.5% CI 100%) and 86.2% (95% CI 86.2% to 86.2%), 
respectively. Specificity and NPV remained high for all 
serum sodium cut-off points (table 2). 

Sensitivity was higher among admissions to internal 
medicine departments than among admissions to surgi- 
cal, gynaecological/obstetric, paediatric and 'other' 
departments (table 3). The validity measures were virtu- 
ally unchanged across the strata of the admission year. 

Sensitivity analyses 

Compared to the primary analyses, we observed no 
changes in either sensitivity or specificity estimates when 
including only patients with at least one serum sodium 
measurement during their hospitalisation in the analysis. 
PPV increased slightly for all serum sodium cut-off 
points, while NPV decreased for the three highest 
cut-off points. Including only patients with more than 
one serum sodium measurement also yielded almost 
identical results (table 4). 



After restriction to the most specific ICD-10 codes for 
hyponatraemia, PPV increased slightly and sensitivity 
decreased (94.6% (95% CI 93.6% to 95.6%) and 0.7% 
(95% CI 0.6% to 0.7%), respectively). Estimates of speci- 
ficity and NPV were virtually unchanged (table 4). 

We observed a slight increase in sensitivity for serum 
sodium cut-off points <130 mmol/L but not for the 
overall estimate when restricting to the first hospitalisa- 
tion in the study period. PPV and NPV generally 
increased, although only very slightly for the overall esti- 
mate (table 4). 



DISCUSSION 

This is the first study to report on the validit)^ of ICD-10 
coding of hyponatraemia using comprehensive 
population-based medical registries and including patients 
of all ages. A record of a hyponatraemia diagnosis in the 
DNRP was found to be specific to and highly predictive of 
hyponatraemia confirmed by laboratory values. However, 
the disorder was greatly under-reported, though to a lesser 
extent in patients admitted to an internal medicine 



Table 2 Validity of ICD-10 codes for hyponatraemia recorded in the DNRP, using serum sodium measurements in the 
LABKA research database as the gold standard 




Hyponatraemic serum sodium ICD-10 code for hyponatraemia 

value recorded in the LABKA recorded in the DNRP* 



research database (mmol/L) 


Yes 


No 


Total 


Validity measures, % (95% CI) 


Overall 
















Yes 


5410 


301 008 


306 418 


Sensitivity 


8 (1.7 to 1.8) 


^Na<135* 


No 


440 


1 879 784 


1 880 224 


Specificity 


100 (100 to 100) 




Total 


5850 


2 180 792 


2 186 642 


PPV 


92.5 (91.8 to 93.1) 












NPV 


86.2 (86.2 to 86.2) 


Cut-off points for increasing severity of hyponatraemia 










Yes 


4528 


80 605 


85 133 


Sensitivity 


5.3 (5.2 to 5.5) 




No 


1322 


2 100 187 


2 101 509 


Specificity 


99.9 (99.9 to 99.9) 


^Na<130t 


Total 


5850 


2 180 792 


2 186 642 


PPV 


77.4 (76.3 to 78.5) 












NPV 


96.3 (96.3 to 96.3) 




Yes 


3261 


21 544 


24 805 


Sensitivity 


13.1 (12.7 to 13.6) 




No 


2589 


2 159 248 


2 161 837 


Specificity 


99.9 (99.9 to 99.9) 




Total 


5850 


2 180 792 


2 186 642 


PPV 


55.7 (54.5 to 57.0) 












NPV 


99.0 (99.0 to 99.0) 


Na<120§ 


Yes 


2061 


6219 


8280 


Sensitivity 


24.9 (24.0 to 25.9) 




No 


3789 


2 174 573 


2 178 362 


Specificity 


99.8 (99.8 to 99.8) 




Total 


5850 


2 180 792 


2 186 642 


PPV 


35.2 (34.0 to 36.5) 


^Na<1151l 










NPV 


99.7 (99.7 to 99.7) 




Yes 


1107 


2127 


3234 


Sensitivity 


34.3 (32.6 to 35.9) 




No 


4743 


2 178 665 


2 183 408 


Specificity 


99.8 (99.8 to 99.8) 


i 


Total 


5850 


2 180 792 


2 186 642 


PPV 


18.9 (17.9 to 20.0) 



NPV 99.9 (99.9 to 99.9) 

*Corresponding to <133 mmol/L for infants <30 days of age. 
tCorresponding to <128 mmol/L for infants <30 days of age. 
^Corresponding to <123 mmol/L for infants <30 days of age. 

§Corresponding to <11 8 mmol/L for infants <30 days. i 
TlCorresponding to <11 3 mmol/L for infants <30 days of age. ' 
DNRP, Danish National Registry of Patients; ICD-10, International Classification of Diseases, 10th revision; NPV, negative predictive value; 
PPV, positive predictive value. ^ 
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Table 3 Validity of ICD-10 codes for hyponatraemia recorded in the DNRP, stratified by age group categories, year and department of admission, for serum sodium 
values <135* and <125 mmol/Lt 



Sensitivity, % (95% CI) 



Specificity, % (95% CI) 



PPV, % (95% CI) 



NPV % (95% CI) 



<135mmol/L <125mmol/L 



<135 mmol/L 



<125 mmol/L 



<135 mmol/L 



<125 mmol/L 



<135 mmol/L 



<125 mmol/L 



Age, years 












<15 


0.2 (0.1 to 0.2) 


3.0(1.5 to 5.2) 


100 (100 to 100) 


100 


(100 to 100) 


15-34 


0.2 (0.2 to 0.3) 


4.7 (3.0 to 6.9) 


100 (100 to 100) 


100 


(100 to 100) 


35-49 


0.9 (0.8 to 1 .0) 


7.8 (6.7 to 9.0) 


100 (100 to 100) 


100 


(100 to 100) 


50-64 


1 .3 (1 .3 to 1 .4) 


9.6 (8.9 to 10.3) 


100 (100 to 100) 


99.9 


(99.9 to 99.9) 


65-79 


1 .8 (1 .7 to 1 .9) 


13.6 (12.9 to 14.4) 


100 (100 to 100) 


99.8 


(99.8 to 99.8) 


>80 


3.4 (3.3 to 3.6) 


21.0 (19.9 to 22.1) 


99.9 (99.9 to 99.9) 


99.5 


(99.5 to 99.5) 


Admission year 












2006 


1 .5 (1 .4 to 1 .7) 


12.5 (11.5 to 13.5) 


100 (100 to 100) 


99.9 


(99.9 to 99.9) 


2007 


1 .4 (1 .3 to 1 .5) 


12.0 (11.0 to 13.1) 


100 (100 to 100) 


99.9 


(99.9 to 99.9) 


2008 


1.7 (1.6 to 1.8) 


12.3(11.3 to 13.3) 


100 (100 to 100) 


99.9 


(99.9 to 99.9) 


2009 


1 .8 (1 .7 to 1 .9) 


12.6 (11.6 to 13.6) 


100 (100 to 100) 


99.9 


(99.8 to 99.9) 


2010 


1 .9 (1 .8 to 2.0) 


14.2 (13.2 to 15.4) 


100 (100 to 100) 


99.9 


(99.9 to 99.9) 


2011 


2.2 (2.0 to 2.3) 


15.2 (14.1 to 16.4) 


100 (100 to 100) 


99.9 


(99.9 to 99.9) 


Department 












Internal medicine 


2.7 (2.7 to 2.8) 


16.5 (16.0 to 17.0) 


99.9 (99.9 to 100) 


99.7 


(99.7 to 99.7) 


Surgical 


0.2 (0.2 to 0.2) 


2.3(1.9 to 2.8) 


100 (100 to 100) 


100 


(100 to 100) 


Gynaecological/ 


0.1 (0.1 to 0.3) 


3.1 (1.2 to 6.7) 


100 (100 to 100) 


100 


(100 to 100) 


obstetric 












Paediatric 


0.2 (0.1 to 0.3) 


3.4(1.7 to 5.8) 


100 (100 to 100) 


100 


(100 to 100) 


Other 


0.3 (0.2 to 0.5) 


1.5 (0.4 to 3.9) 


100 (100 to 100) 


100 


(100 to 100) 



84.4 (67.2 to 94.7) 
80.0 (65.4 to 90.4) 

91 .3 (87.3 to 94.4) 
93.9 (92.2 to 95.3) 
92.9 (91.7 to 94.0) 

92.0 (90.8 to 93.0) 

92.8 (90.8 to 94.5) 

94.4 (92.4 to 96.0) 

91.1 (89.1 to 92.8) 
93.4 (91.7 to 94.8) 
91 .6 (89.8 to 93.2) 

92.2 (90.6 to 93.6) 

92.8 (92.1 to 93.4) 
90.6 (85.8 to 94.3) 

76.9 (46.2 to 95.0) 

85.3 (68.9 to 95.0) 
58.3 (36.6 to 77.9) 



34.4(18.6 to 53.2) 

51.1 (35.8 to 66.3) 

67.2 (61 .2 to 72.8) 

69.6 (66.7 to 72.3) 

57.2 (55.0 to 59.3) 

47.7 (45.7 to 49.7) 

66.6 (63.2 to 69.9) 

65.3 (61 .6 to 68.8) 
53.6 (50.4 to 56.8) 

51.4 (48.4 to 54.5) 
54.4 (51 .4 to 57.4) 

49.8 (47.0 to 52.7) 

56.0 (54.7 to 57.3) 

57.6 (50.5 to 64.5) 
46.2 (19.2 to 74.9) 

35.3(19.7 to 53.5) 

16.7 (4.74 to 37.4) 



94.6 (94.6 to 94.7) 

95.5 (95.4 to 95.5) 
90.8 (90.7 to 90.9) 

83.6 (83.5 to 83.7) 

79.1 (78.9 to 79.2) 

75.7 (75.5 to 75.9) 

86.8 (86.6 to 86.9) 
87.0 (86.9 to 87.1) 

85.9 (85.8 to 86.1) 
85.5 (85.3 to 85.6) 
86.3 (86.2 to 86.4) 
85.8 (85.7 to 85.9) 

80.3 (80.2 to 80.4) 
86.0 (85.9 to 86.1) 
98.0 (97.9 to 98.0) 

90.4 (90.3 to 90.6) 

95.2 (95.0 to 95.3) 



99.9 (99.9 to 99.9) 
99.9 (99.9 to 99.9) 
99.3 (99.3 to 99.3) 
98.5 (98.4 to 98.5) 
98.5 (98.4 to 98.5) 
98.3 (98.3 to 98.4) 

99.0 (98.9 to 99.0) 
99.0 (99.0 to 99.1) 
99.0 (98.9 to 99.0) 

99.0 (98.9 to 99.0) 

99.1 (99.0 to 99.1) 

99.1 (99.0 to 99.1) 

98.3 (98.3 to 98.3) 

99.2 (99.2 to 99.2) 
99.9 (99.9 to 100) 

99.8 (99.8 to 99.8) 
99.7 (99.7 to 99.8) 



*Corresponding to <133 mmol/L for infants <30 days of age. 
tCorresponding to <123 mmol/L for infants <30 days of age. 

DNRP, Danish National Registry of Patients; ICD-10, International Classification of Diseases, 10th revision; NPV, negative predictive value; PPV, positive predictive value. 



Table 4 Sensitivity analyses 



Hyponatraemic 
serum sodium value 
recorded in the 
LABKA research 
database (mmol/L) 



Sensitivity analyses 



Primary analysis (including 
all admissions for all 
patients in the study 
period), % (95% CI) 



Requiring at least one 
serum sodium 
measurement during 
hospitalisation, % (95% CI) 



Requiring >1 serum 
sodium measurement 
during hospitalisation, % 
(95% CI) 



ICD-10 algorithm 
restricted to code 
E87.1Aand P74.2B, % 
(95% CI) 



Restricting to first 
admission per patient in 
the study period, % 
(95% CI) 



Overall 
Na<135 Sensitivity 
Specificity 
PPV 
NPV 




1.8 (1.7 to 1.8) 
100 (100 to 100) 
92.5 (91.8 to 93.1) 
86.2 (86.2 to 86.2) 



Cut-off points for increasing severity of hyponatraemia 
Na<i; 



130 Sensitivity 
Specificity 
PPV 
NPV 

Sensitivity 
Specificity 
PPV 
NPV 

Sensitivity 
Specificity 
PPV 
NPV 

15 Sensitivity 
Specificity 
PPV 
NPV 



5.3 (5.2 to 5.5) 
99.9 (99.9 to 99.9) 
77.4 (76.3 to 78.5) 
96.3 (96.3 to 96.3) 

13.1 (12.7 to 13.6) 
99.9 (99.9 to 99.9) 

55.7 (54.5 to 57.0) 
99.0 (99.0 to 99.0) 

24.9 (24.0 to 25.9) 

99.8 (99.8 to 99.8) 

35.2 (34.0 to 36.5) 

99.7 (99.7 to 99.7) 

34.3 (32.6 to 35.9) 

99.8 (99.8 to 99.8) 
18.9(17.9 to 20.0) 

99.9 (99.9 to 99.9) 



1.8 (1.7 to 1.8) 
100 (100 to 100) 

95.4 (94.8 to 95.9) 
76.9 (76.8 to 77.0) 

5.3 (5.2 to 5.5) 
99.9 (99.9 to 99.9) 
79.8 (78.7 to 80.9) 
93.8 (93.8 to 93.9) 

13.1 (12.7 to 13.6) 

99.8 (99.8 to 99.8) 

57.5 (56.2 to 58.8) 
98.3 (98.3 to 98.4) 

24.9 (24.0 to 25.8) 
99.7 (99.7 to 99.7) 
36.3 (35.1 to 37.6) 
99.5 (99.5 to 99.5) 

34.2 (32.6 to 35.9) 

99.7 (99.6 to 99.7) 
19.5 (18.5 to 20.6) 

99.8 (99.8 to 99.8) 



1.9 (1.8 to 2.0) 
100 (100 to 100) 

95.8 (95.2 to 96.3) 

74.7 (74.6 to 74.8) 

5.6 (5.4 to 5.7) 

99.9 (99.9 to 99.9) 

80.5 (79.4 to 81 .6) 

93.0 (93.0 to 93.1) 

13.6 (13.1 to 14.0) 

99.8 (99.8 to 99.8) 

57.9 (56.5 to 59.2) 

98.1 (98.1 to 98.1) 

25.4 (24.5 to 26.4) 

99.7 (99.7 to 99.7) 
36.3 (35.0 to 37.6) 

99.5 (99.4 to 99.5) 

34.9 (33.1 to 36.6) 

99.6 (99.6 to 99.6) 
19.5 (18.4 to 20.6) 

99.8 (99.8 to 99.8) 



0.7 (0.6 to 0.7) 
100 (100 to 100) 
94.6 (93.6 to 95.6) 
86.1 (86.0 to 86.1) 



1.7 (1.7 to 1.9) 
100 (100 to 100) 

93.5 (92.0 to 94.7) 

91 .6 (91 .6 to 91 .7) 



2.1 


(2.0 to 2.2) 


6.3 


(5.9 to 6.7) 


100 


(100 to 100) 


100 


(100 to 100) 


83.0 


(81.4 to 84.6) 


82.2 


(80.7 to 84.8) 


96.2 


(96.2 to 96.2) 


97.9 


(97.9 to 98.0) 


5.4 


(5.1 to 5.7) 


15.6 


(14.6 to 16.6) 


100 


(100 to 100) 


99.9 


(99.9 to 99.9) 


62.5 


(60.4 to 64.5) 


62.3 


(59.6 to 64.8) 


98.9 


(98.9 to 98.9) 


99.4 


(99.4 to 99.4) 


6.3 


(5.8 to 6.9) 


29.3 


(27.3 to 31 .3) 


100 


(100 to 100) 


99.9 


(99.9 to 99.9) 


50.6 


(47.5 to 53.7) 


43.7 


(41 .0 to 46.4) 


99.6 


(99.6 to 99.7) 


99.8 


(99.8 to 99.8) 


9.3 


(8.3 to 10.3) 


38.8 


(35.5 to 42.1) 


100 


(100 to 100) 


99.9 


(99.9 to 99.9) 


28.8 


(26.1 to 31 .7) 


24.2 


(22.0 to 26.6) 


99.9 


(99.9 to 99.9) 


99.9 


(99.9 to 99.9) 



ICD-10, International Classification of Diseases, 10th revision; NPV, negative predictive value; PPV, positive predictive value. 
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department compared to other departments. We found 
sensitivity to be low even for severe degrees of hyponatrae- 
mia. These results were robust when we used a stricter def- 
inition of hyponatraemia and complete case analysis. 

Our findings correspond to those of Movig et aFs^^ 
single-centre study conducted in the Netherlands, in 
which ICD-9-CM coding of hyponatraemia in inpatient 
discharge records was compared with hospital laboratory 
data. As in our study, sensitivity at the cut-off point of 
135 mmol/L was 1.7%, and increased with decreasing 
serum sodium levels. Sensitivity thus reached 30.6% for 
values below 115 mmol/L. In addition, their estimates 
for PPV, NPV and specificity were similar to our results 
(91.7%, 79.5% and <99.9%, respectively). A Canadian 
study by Gandhi et al^^ examined ICD-10 coding for 
hyponatraemia and reported a sensitivity of 6.4% for the 
cut-off point of <135 mmol/L and 41.7% for the cut-off 
point of 125 mmol/L. The study, however, was restricted 
to patients >66 years of age presenting with serum 
sodium values at the time of admission or emergency 
department contact. In line with their results, we found 
that the median age of patients with an ICD-10 code of 
hyponatraemia recorded in the DNRP, which could be 
confirmed by laboratory results, was higher than that of 
patients with hyponatraemia with no ICD-10 code for 
hyponatraemia recorded in the DNRP. However, the sen- 
sitivity estimates did not reach those found by Gandhi 
et al even for patients 65-79 and >80 years of age. Shea 
et al^"^ also reported higher sensitivity compared to our 
results (3.5% for a cut-off point of <136 mmol/L and 
29.6% for the cut-off point of 125 mmol/L) in their 
study examining the validity of ICD-9 codes of hypona- 
traemia in an outpatient managed-care population. 
Outpatient serum sodium laboratory tests were com- 
pared with outpatient professional ICD-9 claims regis- 
tered within 15 days before or after the laboratory claim. 
The PPV was 62.6% for serum sodium levels 
<136 mmol/L and 10.4% for levels <125 mmol/L. As 
noted in the paper, detected hyponatraemia may be the 
cause for follow-up visits in an outpatient setting, 
without the need for repeat measurements. This could 
lead to a lower PPV compared to our study and the 
study by Movig et al. In addition, managed-care claims 
databases encompass an employer-based commercially 
insured population. Thus, Shea et aFs study may not be 
representative of elderly populations, in which preva- 
lence of hyponatraemia is high.^^ This may also 
explain why their results differed from ours. 

The major strengths of our study are its population- 
based design and unambiguous individual-level linkage 
between registries containing complete data on all hos- 
pitalisations and laboratory tests in a well-defined popu- 
lation. This eliminates the risk of selection bias. Several 
potential study limitations must be considered. We relied 
on only one (the lowest) serum sodium value recorded 
to define the presence of hyponatraemia, and did not 
consider the duration of hyponatraemia. Clinicians may 
be more likely to regard hyponatraemia as clinically 



relevant, and hence to include the condition in dis- 
charge diagnoses, if it is detected in more than one 
measurement. In this context, it is important to note 
that patient transfers between departments are regis- 
tered as separate admissions in the DNRP and that we 
examined the validity of ICD-10 coding for each regis- 
tered admission. The PPV may have been even higher if 
we had considered contiguous admissions as a single 
admission. Finally, we chose to include patients without 
serum sodium measurements and to consider them as 
normonatraemic in the main analysis. We did so to 
detect false-positive diagnoses and thereby obtain accur- 
ate estimates of predictive values. Serum sodium is often 
measured as a routine procedure, and rarely due to spe- 
cific suspicion. Although frequently measured, the pro- 
portion of patients with unacknowledged hyponatraemia 
is most often unknown. We therefore performed a com- 
plete case analysis, including only patients with serum 
sodium measurements. As the results did not differ 
markedly from those of the primary analysis, we believe 
that including patients without serum sodium measure- 
ments in the normonatraemic group was justified. 

We can only speculate on the reasons for the low sensi- 
tivity of the ICD-10 coding of hyponatraemia found in 
our study. A diagnosis of hyponatraemia was less likely to 
be recorded in patients with high levels of comorbidity, 
which may indicate that hyponatraemia is mainly consid- 
ered a bystander of the underlying diseases. If hypona- 
traemia is mild or transient, and does not require 
intervention or specific attention, it may not warrant 
documentation. However, even for very severe hypona- 
traemia (<1 15 mmol/L), which is potentially fatal and 
requires immediate intervention, sensitivity was low. We 
believe that this most likely reflects negligence of proper 
coding practice rather than lack of attention to the clin- 
ical importance of low serum sodium levels. With the 
increasing use of electronic medical records, it would be 
feasible and worthwhile to automatically assign discharge 
diagnoses to patients with gross abnormal laboratory 
values. However, the ultimate responsibility for summar- 
ising the most important reasons for treatment and care 
still rests on the discharging physician. Our results 
suggest that hyponatraemia is not coded in the presence 
of coexisting illness deemed more important, and that 
the fact that hyponatraemia may be an important indica- 
tor of a poor prognosis is not yet acknowledged. 

The results of this validation study emphasise the need 
for caution when relying on ICD-10 codes for hyponatrae- 
mia in research. Based on the estimated PPV and specifi- 
city, patients with an ICD-10 code of hyponatraemia can 
safely be assumed to actually have hyponatraemia. 
However, the low sensitivity renders the ICD-10 codes 
inappropriate for use in studies examining prevalence, 
incidence and absolute risk, due to a high degree of mis- 
classification. Sensitivity increased with decreasing serum 
sodium levels, suggesting that studies using ICD-codes to 
identify hyponatraemia would be based mainly on severe 
cases. Furthermore, our results indicate that quality of 
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registration differs according to age, gender and morbid- 
ity status. Hence, studies may be susceptible to differen- 
tial misclassification, again resulting in biased results. 

Conclusion 

We found that the ICD-10 coding of hyponatraemia in 
DNRP has high specificity but is highly incomplete, 
resulting in very low sensitivity. When available, labora- 
tory test results for serum sodium will more correctly 
identify patients with hyponatraemia. 
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